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ABSTBACT , 

Hhenj Aoraing tests,, it aay be preferabW to u&e^the 
■atrix sappling technigne. The results froa the saaples aay be used ^ 
to estimate vhat the distribution o£ scores vocld have i)een if each 
subject^ had taken ^ll the iteas. This paper compares fpur methods for 
^■akiirg these ^stiaa^tes. The saaple size a&de it possible to cpapare 
the tec^ni^ues in a aore realistic way than had other studies vith 
■uch saalier sanple sizes. Differences between the criterion 
distribution and the estimates are tabled. Conclusions and 
liaitations are stated. (Author) ^ 
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A continuing problem in educational measurement is the normlng of stand-* 
ardized tests. Because such tests must be of reasonable length to help assure\ 
high reliability, they frequently recjfuire long periods of time for administration. 
It is this very length that may deny a test developer access to representative 
norms since educators are not apt to permits the use of an excessive amount of 
the time of their.students for this activity- Matrix sampling can be used in 
such situations because it requires less time per examinee, and therefore may 
encourage more cooperation. 

However, once the matrix sampling procedure has been concluded, the only 
Information available is the scores of the subjects on the samples of items 
they took. Since the topic of interest usually is the development of norms 
for the total test, some way must be found to estimate what the distribution 
of test scores would have been if the examinees had taken all of the items 
rather than Just a sample of them-. ^ 
The purpose of this paper will be to compare the accuracy of three 
different techniques which are available for use in the estimation process. 
The results should help to clarify the differences between them. 

Currently availa ble technloueg . There currently are available several 
approaches which can be used to estimate total-test scdre distributions from 
matrix sampling results. Most require the knowledge of the first few moments 
I P of the total-test score distribution, but these can bei estimated from the 
matrix Bsmple results (Lord, 1969). 1 

One of these approaches is to use a distribution ^ich requires only the 
first few moments to define it. . The negative hypergeometric (Keats and Lord, 
1962) *has been the one most frequently appearing in the literature. The 
sufficient parameters are total-test mean and varlatice, and K. However, there 
is some evidence that a model distribution which requires more moments to fit 
it, such as the Pearson Type I, will yield better estimated distributions 
I ^ (Brandenburg and Forsyth, 1973) . 

I I The disadvantage of this approach is that there generally are fairly 

restrijctive assuoiptlons underlying' the model, and one cannot be sure that any 
particular test does not violate them. When the assumptions are not violated, 
this approach works well, but the results can yield subfiitantlal errors when 
they are violated. 



^Paper presented at the Annual Meeting of the American Educational Research 
Association, Chicago, 1974. 

^Paper originally titled "A Comparison of Four Techniques Available to* 
Estimate Total-Test Score Distribution Following Matrix Sampling." Unexpected 
problems in the development of a computer program to generi^te estimated results 
using the empirical Bayea' estimation technique (Lord, 1969) nece&Tsitated the 
•elimination of those results from this paper. 
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A second cat^goxy of approaches to the estlidatlon of a total-test score 
distribution has been to predict a total- test score for each Individual, and 
thc^n combine the results for the Individuals into a groujp distribution. Tm 
different method^ are available which use this approach (Kleinke, 1969 and 
Bunda, 1971 and 1973)\ A major disadvantage of Kleinke's linear prediction 
approach is that the predicted scores tend to cluster around a few points, 
resulting in a very jagged estintated total- test score distribution. Bunda's 
_ approach requires the use of a balanced incomplete- block design as suggested 
by Knapp (1968) to estimate item covariances. The iiiq>lementation of a BIBD 
generally is not considered practical; it only has been used in a few post hoc 
studies. 

A third approach is the use of a strong theory, requiring weak assumptions. 
One example of this is the empirical Baye's estimation technique (Lord, V1969) • 
This method uses an empirical Bayesian procedure to obtain minimum squared error 
estimators for total-test score parameters. Another approach involves the 
use of guesBlng-^free distributions as an intermediate step (Hill, 1972 and 1973). 
The major disadvantage of these approaches is the requirement for large amounts 
of data to avoid uninterpretable results. Also, unique solutions cannot be 
found to any problem with either approach unless one makes some further 
y assumptions. . 

Although there have been some post hoc studies which have compared two or 
more of these methods, the ssunple sizes used generally have been much smaller 
than they would be in a nationwidift test-normlng sample. Since the effectiveness 
of the methods is at least partially dependent upon the number of subjects 
used in the estimation process, there never have been any conclusive results. 

This paper compares three of these techniques, one from each ^category. 
The techniques selected are those due to Lord (negative hjnper geometric) , 
Kleinke (linear prediction) and Hill (guessing-free distributions). 

A post hoc comparison of these three methods of estimating total-test ^ 
score distributions following matrix sampling was done using a sample size 
which more closely reflects the size normally encounteried in a real-rlife testing 
problem. The purpose of the study to determine which method, if any, could 
I be chosen for use in test norming situations. - ^ 

I Procedure . Through the kind assistance of Dr. Frederic Lord of Educational 
I Testing Service, data were obtained on the responses of over 100,000 subjects 
on a 90-item test. The 90 items were randomly selected into 10 sets of 9 items 
each. The subjects were assigned to one of ten groups using systematic sampling; 
a total of 10,327 subjects were assigned to each grdup. Each group was 
assigned to an item sample. Ten total- test score distributions were estimated 
I from the results of the item-*subject samples for each of the four methods. 
; The ten estimated distributionis were then combined, by taking the mean prob^ 
/ability for each point on the total-test score scale, to form a final estimated 
j total-test score distribution for each method. The estimated total-test score 
; distributions were compared to the original criterion total-test score distri- 
Bution of the 103,276 subjects using two statistics? the Kblmogorov-Smirnov D 
and the mean deviation from criterion. 

Two statistics were calculated because each has a weakness. The Kolmogorov- 
Smlmov D simply is the greatest difference at any point between the cumulative 
relative frequency distributions of the estimated and criterion distributions. 
It is of interest because it is the maximum error that can be made. Hoifever, 
*L*^^5? ^ advantage to estimation procedures which have severe limiting 
assumptions, and therefor^ very smooth estimated total-test score distributions 
(such as the negative hypergeometrlc) . It also severely penalizee techniques 
. which have very jagged estimates of . the total-test score distribution (such as 



Results ♦ The estimated total-test scoi^e distributions for each of the nine 
samples are shovm In Appendix A. A final estimated totdl-*test score distribution 
was derived from these results by calculating the mean of the expected frequencies 
for each score across all nine samples. The resultant cumulative frequency 
distributions are shown in Table 1. The Kblmogorov-Smlmov D statistic and 
mean deviations as calculated by comparing the ^estimates to the criterion are 
Bhovn In Table 1. 

Discussion . The results shown in Tables 1 and 2 reconfirm to a large degree 
those found by Hill (1972), This is true even though the number of subjects used 
in this study was 20 times that of the earlier study.' The D was lowest for the 
negative hypergeometric distribution, while the mean devlatTbn was lowest for 
linear prediction. 

A problem with the guessing-^free distribution approich has been the error 
in estimation of hi^her-order moments. Hill (1972) found vith sample slses of 
approximately 1000 subjects, four or five moments could be estimated. With the 
sample sizes used in this study (10,000 subjects per saof^le), five or six moinents 
could be estimated in each case. Unfortunately, it appears as though a 
greater nundber of moments must be estimated more accurately before this approach 
will work substantially better than the other tvro.. 

Another finding of Hill (1972) was reconfirmed ''^th the larger sample size: 
the guesslng-free distribution approach. yields very accurate estimations In 
both tails. For the lowest 35 and itie highest 20 scores on the total-test 
score disrrlbution, error was less than one percenj^ile. 

This data analysis, of course, hardly begins to scratch the surface of 
answering the question of which technique should be used in any particular 
circumstance. The number of item amplea used, the number of subjects used per 
sample, the inter-item correlations, the variance of item difficulties, and 
the shape of the total-test score distribution would have an effect on thift ! 
results. Further research will be necessary before any definitive statement 
about the relative merit of these approaches can be made. 



Table 1. Estimated Total-Test Score Distributions and Deviations from Criterion 
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Table 2. Kolmogorov^Snirnov D and tiean Deviation from Criterion 
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LINEAR NEGATIVE GUESSING FREQUENCY 
PREDICTION HYPERGEOMETRIC FREE DISTRIBUTION 
Cumu— Cumu— CuQu— Cunu" 
lative latlve latlve lative 
Propor- Proper- Proper- Propor- Propbr- Propor- Proper- Propor- 
tion tlon tlon tlon tlon tlon tlon tlon 



'0 .0 .0000 .0000 .0000 .0000 .0000 .0000 

1 '0 .0 .0000 .0000 .0000 .0000 .0 .0900 - 

2 .0 .0 .0000 .0000 .0000 .0000 - .0 ,-...0000 

3 .0 , .0 .0000 .0000 .0000 .0000 -.0 iOOOO 
* .0 .0 .0001 .0001 .0000 .0000 .0 - .0000 

5 .0 .0 .0001 .0002 -.0000 .0000 .0000 .0000 

6 .0 .0 ' .0001 .0003 .0000 .0000 .0000 iOOOd 

7 .0029 .0029 .0002 .0006 .0000 .0000 .0000 .^001 

8 .0 .0029 .0003 .0009 .0000 .0000 .OOOi .0002 

9 .0 .0029 ; .0004 .0013 .0000 .0000 ..0001 .0002 

10 .0 .0029 .0006 .0019 .0000 .0000 .0002 .0004 

11 .0 .0029 .0008 .0027 .0000 .X)000 .0003 .0007 
12. .0 .0029 .0010 .0037 .0000 .0001 .0003 .0010 

13 .0 .0029 .0013 .0050 .0001 .0002 .0006 .0015 

14 .0165 .0194 .0016 .0066 .0001 .0003: .0008 .0024 

15 .0 .0194 .0019 .0086 .0002 .0004 .0012 .0035 

16 .0 .0194 .0023 .0109 .0003 .0007 .0014 .0050 

17 .0 .0194 .0028 .0136 .0005 .0011 .0017 :0067 
-J^ -^;0 . 019 4 rf032 — .0169 i^OOT ri^ei9 - -.0025 ^t0092 

19 .0, .0194 .0038 .0207 .0012 .0031 .0029 .0121 

20 .0 .0194 ' .0043 .0250 .0018 .0048 .0035 .0156 

21 .0504 .0697 .0049 .0299 .0026 .0074 .0044 .0201 

22 .0 .0697 .0056 .0355 .0035 .0109 .0059 .0260 

23 .0 .0697 .0063 .0418 .0045 .0154 .0066 .0325 

24 .0 -.0697 .0070 .0489 .0054 .0208 .0078 .0404 

25 .0 .0697 .0078 .0567 .od62 .0270 .0091 .0494 

26 .0 .0697 .0086 .0652 .0068 .0338 .0107 .0601 

27 .0 .0697 .0094 .0747 .0072 .0409 .0116 .0717 

28 .1004 .1701 .0103 .0849 .0074 .0483 .0128 .0846 

29 .0 .1701 .0111 .0961 .0076 .0560 .0151 .0996 

30 .0 .1701 .0120 .1081 .0078 .0637 .0167 .1163 

31 .0 .1701 .0129 .1210 .0079 .0716 . .0181: .1346 

32 .0 .1701 .0138 .1348 .0078 .0794 .0202 .1549 

33 .0 .1701 .0147 .1495 .0074 .0868 _ .0208 .1757 

34 .0 .1701 .0156 .1651 .0068 .0935 .0229 .1986 

35 .1614 .3316 .0165 .1816 .0063 .0998 .0248 .2234 

36 .0 ^ .3316 .0174 .1990 .0066 .1064 .0244 .2478 

37 .0 .3316 .0182 .2172 .0087 .1150 .0264 .2742 

38 .0 .3316 .0190 .2362 .0139 .1289 .0275 .3017 

39 .0 .3316 .di98 .2560 .0229 .1518 .0274 .3291 

40 .0 .3316 .0206 .2766 .0355 .1873 .0292 .3583 

41 .0 .3316 .0213 .2978 .0497 .2369 .0288 .3872 

42 . .1770 .5086 .0219 .3198 .0624 .2993 .0290 .4161 



LINEAR NEGATIVE ^ GUESSING FREQUENCY 

PREDICTION HYPERGEOliETRIC FREE DISTRIBUTKHI 



Score 



Prop, 



Cum. 
Prop. 



Prop. 



Cum. 
Prop. 



Prop. 



Cum. 
Prop. 



Prop. 



Cum. 
Prop. 



A3 


.0 


.5086 


44 


.0 


.5086 


45 


.0 


.5086 


46 


.0 


.5086 


47 


.0 


.5086 


48 


.0 


• .5086 


/•a 


.0 


. 5086 


50 


.1670 


.6756 


51 


.0 


.6756 


52 


.0 


.6756 


53 


.0 


.6756 


54 


.0 


.6756 


55 


.0 


.6756 


56 


.0 


.6756 


57 


.1388 


.8144 


58 


.0 


.8144 


59 


.0 


.8144 


60 


.0 


.8144 


61 


.0 


.8144 


62 


.0 . 


.8144 


63 


.0 


. 8144 


—64 


.1014 


.9158 








65 


.0 


.9158 


66 


.0 


.9158 


67 


.0 


.9158 


68 


.0 


.9158 


69 


.0 


.9158 


70 


.0 


.9158 


71 


.0584 


.9741 


72 


.0 


.9741 


73 


.0 


.9741 


74 


.0 


.9741 


75 


.0 • 


.9741 


76 


.0 


.9741 


77 


.0 


.9741 


78 


.0259 


1.0000 


79 


.0 


-1.0000 


80 


.0 


1.0000 


81 


.0 


1.0000 


82 


.0 


1.0000 


83 


.0 


l.COOO 


. 84 


.0 


1.0000 


85 


.0 


1.0000 


86 


.0 


1.0000 




.0 


1.0000 




.0 
.0 


1.0000 
1.0000 


90 


.0 


1.0000 



.0225 
.0231 
.0236 
.0240 
.0243 
.0246 
.0248 
.0249 
.0250 
.0249 
.0248 
.0246 
.0243 
.0240 
.0235 
.0230 
.0224 
.0218 
.0211 
.0203 
.0194 
.0185 



.0176v 

.0166 

.0156 

.0146 

.0136 

.0125 

.6lU 

.0104 

.0094 

.0084 

.0074 

1 0065 

.0056 

.0047 

.0040 

.0033 

.0026 

. 0020 

.0015 

.0011 

.0008 

.0005 

.0003 

.0002 

.0001 

.0000 



.3423, 
.3654 
.3889 
.4129 
..4373 
.4619 
.4867 
.5116 
.5366 
.5615 
.5863 
,6110 
.6353 
.6593 
.6828 
.7058 
.7283 
.7500 
.7711 
.7914 
.8108 
-.8293- 
.8469 
.8636 
.8792 
.0938 
.9073 
.9198 
.9313 
.9417 
.9511 
.9594 
.9668 
.9733 
.9789 
.9836 
.9876 
.9908 
.9935 
.9955 
.9971 
.9982 
.9990 
.9995 
.9998 
.9999 
1.0000 
1.0000 



.0706 
.0720 
.0666 
V0562 
.0435 
.0313 
.0214 
.0146 
.0105 
.0082 
.0068 
.0057 
.0047 
.0036 
.0027 
.0018 
.0012 
.0008 
.0009 
.0020 
.0049 
^0108- 



.0204 
.0319 
.0410 
.0440 
.0396 
.0301 
.0196 
.0109 
.0052 
.^022 
.0008 
.0003 
.0004 
.0006 
.0006 
. 0004 
.0002 
.0001 
.0003 
.0005 
.0004 
.0002 
.0000 
.0017 
.0008 
.0078 



.3699 
.4419 
. 5085 
.5647 
.6082 
.6395 
.6609 
.6755' 
. 6859 
.6941 
.7010 
.7067 
.7114 
.7150 
.7177 
.7195 
.7207 
.7215 
.7224 
.7243 
.7292 
- .7401 
.7605 
.7923 
.3334 
.8773 
.9169 
.9470 
.9666 
.9775 
.9827 
.9849 
.-9857 
.9860 
.9865 
.9871 
.9876 
.9880 
.9882 
;9883 
.9886 
,9891 
.9895 
.9897 
.9897 
.9914 
19922 

liodoo 



.0298 
.0302 
.0291 
.0299 
.0285 
.0278 
.0277 
.0263 
.0249 
.0244 
.0233 
.0221 
.0216 
.0201 
.0191 
.0177 
.0159 
.0153 
.0149 
.0136 
.0125 
-.^013- 
.0110 
.0100 
.0095 
.0084 
*0077 
.0068 
.0064 
.0053 
.0052 
.0047 
.0040 
.0036 
.0030 
.0027 
.0021 
.0020 
.0015 
.0012 
.0010 
.0007 
.0004 
.0002 
.0002 
.0001 
.0001 
.0 



.4459 
.4761 
.5052 
.5351 
.5635 
.5913 
.6190 
.6453 
.6702 
.6946 
.7179 
.7399 
.7615 
.7816 

. .8007 
.8183 

„ .8342 
.S496 
.8645 
.8781 
.8905 
.901 9 
.9129 
.7228 
.9324 
.9408 
.9485 
.9553 
.9613 
.9671 
.9723 
.9771 
.. ?B11 
.9847 
.9877 
.9905 
.9926 
.9945 
.9960 
.9373 
.9983 
.9989 
.9994 
.9996 
.9998 
.9999 

1.0000 

1.0000 



REStLTS FOR ITEM SAMPLE # 2 



Sco|€ 



LINEAR 
PREDICTION 

lative 
Proper- Propor- 
tion tlon 



NEGATIVE 
f UYPERGEOMETRIC 
Cumu- 
lative 
Propor-. Propor- 
tion tlon 



GUESSING 
FREE 

Cumu- 
lative 
Propor- Propor- 
tion tloii 



FREQUENCY 
DISTRIBUTION 
Cumu- . 
latlVe 
Propor- Propor- 
tion tion 



0 
1 
2 
3 
4 
5 
6 
7 
8 
9 
10 

11. 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
. 35 
36 
37 
38 
39, 
40 
41 

FRir 



.0 " 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0048 

.0 

.0 

.0 

.0 

.0 

.0186 

.0 
.0 
iO 
.0 
.0 

.0543 

.0 

.0 

.0 

.0 

.0 

.0 

.1100 

.0 

.0 

.0 

.0 

.0 

.1791 

.0 

.0 

.0 

.0 

.0 



.0 
.0 
.0 
.0 
.0 
«0 
.0 
.0 
.0 
.0 
.0 
.0 

.0048 
.0048 
.0048 
.0048 
.0048 
.0048 
.0234,, 
-r0234- 
.0234 
.0234 
.0234 
.0234 
.0234 
.0778^ 
.0778 
.0778 
.0778 
.0778 
.0778 
.0778 
.1878 
.1878 
.1878 
.1878 
.1878 
.1878 
.3669 
.3669 
. 3669 
.3669 
.3669 
.3669 



.0000 
.0000 
.0000 
.0000 
.0000 
.0000 
.0000 
.0001 
.0001 
.0002 
.0003 
.0004 
.0005 
.0007 
.0010 
.0013 
.0016 
.0020 
.0025 

.0037 
.0045 
.0053 
.0061 
.0071 
,0081 
.0092 
.0104 
.0116 
.0129 
.0142 
.0155 
.0169 
.01,82 
.0196 
.0209 
.0222 
.0234 
.0245 
.0256 
.0266 
.0274 
.0282 
.0288 



.0000 
.0000 
.0000 
.0000 
.0000 
.0000 
.0001 
.0001 
.0003 
.0004 
\.0007 
0011 

.\ooie 

.0023 
.0033 
.0045 
.0p6I 
.0082 
.0107 
-T03r38 

;oi75 

.0220 
.0273 
.0334 
.0405 
.0487 
.0579 
.0683 
.0799 
.0929 
.1071 
.1226 
.1395 
.1578 
.1773 
.1982 
.2204 
.2438 
.2683 
.2339 
.3265 
.3479 
.3761 
.4049 



.0000 

.0000 

.0000- 

.0006 

.0000 

.0000 

.0000 

.0000- 

,0001 

.0001 

.0003 

.0006 

. 0009 

.0014 

.0020 

. 0026 

.0031 

. 0035 

.0037 

.0037 

.0034 

.0030 

.0026 

. 0021 

.0017 

.0013 

.0010 

.0009 

.0009 

.0010 

.0012 

.0014 

.0016 

.0019 

y0028 

10052 

.\pi06 

.0201 

.0339 

,0507 

.0672 

.0795 

.0848 

.0819 



.0000 

.0000 

.0000- 

.0000 

.0000 

.0000 

.0000 

.OOQO 

.0001 

.0002 

.0006 

.0011 

.0021 

.0035 

.0055 

.0081 I 

.0113 j 

.0148 ! 

.0185 

.0222 I 

.0256! 

.0286 

.0312 

.0333 

.0350! 

.0363 

.0373; 

.0382 

.0391! 

.0401 

.0412 

.0426 

.0442 

.0461 

.0489 

.0541 

.0647 

.0847 

.1187 

.1694 

.2366. 

.3161 

.4009 

.4828 



.0000 
.0 
.0 
.0 

*.0 

,0000 
.0000 
.0000 
.0001 
^.0001 
.0002 
.0003 • 
.0003 
.0006 
.0008 
.0012 
,0014 " 
.0017 
.0025 
.0029 
.0035 
.0044 
.0059 
,0066 
.0078 
.0091 
.0107 
.0116 
.0128 
.0151 
.0167 
.0183 
.0202 
.0208 
.0229 
.0248 
.0244 
.0264 
.0275 
.0274 
.0292 
.0288 
.0290 
.0298 



.0000 
.0000 

- .QOQQ 
.0000 
.0000 
.0000 
.0000 
.0001 
.0QQ2 
.0002 
.0004 
.0007 
.0010 
.0015 
.0024 
.0035 
.0050 
.0067 
.0092 
.0121 
. 0156 
.0201 
.0260 
.0325 
.0404 
.0494 
.£>6,01 
.d717 

" .0846 

J. 0996 
.1163 
.1346 
.1549 
.1757 
.1986 
.2234 
.2478 
.2742 
. 3017 
. 3291 
.3583 

' .3872 
.4161 
.4459 



LINEAR 
PREDICTION 



' NEGATIVE 
HYPERGEOMETRIC 



GI^SSING 
FREE 



FREQUENCY 
DISTRIBUTION 



Score 


Prop. 


Cum. 
Prop. 


Prop. 


Cum. 
Prop. 


Prop. 


Cum. 
Prop. 


Prop. 


Cum. 
Prop. 




.0 


.3669 


.0293 


.4342 


■ 

.0725 


.5554 


.030i2 


/.4761 - 


45 


.2030 


.5699 


.0297 


. .4639 


.0594 


.6148 


.0291 


r5052 


46 


.0 


.5699 


.0299 


.4938 


.0456 


.6604 


.0299 


.5351 


47 


.0 


.5699 


.0299 


.5238 


.0332 


• .6936 


.0285 


.5635 


48 


.0 


/ .5699 


J)299_ 


. 5516 


.0233 


^68 


. 0278- 


. 5913 


49 




.5699 


.0296 


.5832 


.0159 


.7327 


.0277 


.6190 


50 


.0 


.5699 


.0292 


. 6125 


.0106 


.7433 


.0263 


.(=453 


51 


•0 


.5699 


.0287 


.6412 


.0068 


.7502 


.0249 


.6702 , 


52 


.1813 \ 


.7511 


.0281 


.6693 


.0043 


.7544 


. 0244 


.6946 7 


53 


.0 \ 


.7511 


.0273 


.6965 


.0026 


. 7570 


.0233 


.7179 


54 


.0 


.7511 


\ .0264 


.7229 


.0016 


.7585 


.0221 


.7399 


55 


.0 / 


, .7511 


.0254 


.7483 


.0013 


.7599 


.0216 


.7615 j 


56 


.0 


.7511 


^0242 


. 7725 


.0023 ; 


.7621 


.0201 


.7816 1 


57 


.0 


.7511 


.0230 


.7955 


.0047 


.7669 , 


. P191 


.8007 


58 


.1334 


.8846 


; .0218 


.8173 


.008^ 


. 7758 


.0177 


.8183 


59 


".0 


.8846 


.0205 


.8378 


.0145 


.7903 


.0159 


.8342 


60 


.0 


.8846 


.0191 


.8569 


.0205 


:8108 


. 0153 


.8496 


61 


.0 


.8846 


.0177 


.8746 


.0258 


.8366 


.0149 


.8645 


62 


... .0 


.8846 


.0163 


.8909 


.0293 


.8659 


.0136 


.8781 


63 


.0 


.8846 


.0149 


.9058 


.0304 


.8962 


.0125 


.8905 


64 


.0 


.8846 


.0135 


.9193 


.0288 


^9250 


.0113 


.9019 


65 


.0758 


.9604 


v0122 


.9315 


.0246 


.9496 


.0110 


.9129 


66 


.0 


.9604 


.0109 


.9424 


.0189 


.9686 ' 


.0100 


.9228 


67 


.0 


.9604 


.0096 


.9520 


.0131 


.981^ 


.0095 


.9324 


68 


.0 


.9604 


.0084 


.9604 


.0081 


.9898 


.0084 


J 9408 


69 


.0 


.9604 


.0073 


.9678 


.0047 


.9944 


.0077 


.9485 


70 


.0 


.9^04 


.0063 


.9741 


J0025 


' .9969 


.0068 


,.9553 


71 


.0 


.9604 


.0053 


.9794 


.0013 


.9982 


. 0064 


.96ld 


72 


.0330 


.9934 


.0045 


.9839 


.0006 


.9988\ 


.0053 


.9671 


73 


.0 


.9934 


.0037 


.9876 


.0003 


.9991 \ 


.0052 


.9723 


74 


.0 


.9934 


.0030 


.9906 


.0001 \ 


.9992 


.0047 


.9771 


75 


.0 


-.9934 


.0024 


.9931 


.0000 


\ .9992 


.0040 


.9811 


76 


.0 


.9934 


.0019 


.9950 


.0000 


.9992, 


.0036 


.9847 


77 


.0 


.9934 


.0015 


.9964 


.0000 


.9993 


.0030 


.9877 


78 


.0066 


1.0000 


.0011 


.9976 


.0001 


.9993 


.0027 


.9905 


79 


.0 


1.0000 


.0008 


.9984 


.0001 


.9994 


.0021 


.9926 


80 


.0 


1.0000 


.0006 


.9990 


.0001 


.9995 


.0020 


.9945 


81 


.0 


1.0000 


.0004 


.9994 


.0001 


.9996 


.0015 


.9960 


82 


•2' 


1.0000 


.0003 


.9996 


.0001 


.9997 


.0012 


.9973 


83 


.0 


1.0000 


.0002 


.9998 


.0000 


.9997 


.0010' 


.9983 


84 


.0 


1.0000 


.0001 


.9999 


.0000 


.9997 


. 0007 


19989 


85 


.0 


1.0000 


.0001 


1.0000 


.0000 


.9997 


.0004 


.9994 


86 


.0 


1.0000 


.0000 


i.oboo , 


.6001 


.9998 


.0002 


^^9996 


87 


.0 


1.0000 


.0000 


1.0000 


.0001 


. 9999 


.0002 


.9998 




.0 


1-0000 


.0000 


1.0000 


.0000 


.9999 


.0001 


.9999 




.0 
.0 


1.0000 
1.0000 


.0000 
. .0000 


1.0000 
1.0000 


.0000 
.0001 


.9999 
1.0000 


. 0001 
.0 . 


i.ooop 

1.0000 



RESULTS FOR ITEM SAMPLE # 3 



Score 



LINEAR 
PREDIQTION ' 
Cumu- 
lative 
Propor- Propor- 
tlop tlon 



NEGATIVE • 
HYPERGEOJETRIC 
Cumu- 
lative 
Propor- ■ Propor-^ 
tlog .tlon- 



GUESSING 
FREE 
Cumu- 
lative 
Propor- Propor- 
tlon tlon 



FREQUENCY 
DISTRIBUTION 
CumU'- 
latlye 
Prcpor- Propor- 
tlon tlon 



0 
1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
39 
40 
41 
42 
43 
44 

45 



.0 

.0 
.6 

.0 
.0 
.0 
.0 
.0 
.0 
.0 
.0 
.0 
.0 
.0 
.0 
.0 
.0 

.0113 
.0 

.0 ^ 

.0 

.0 

*.o 

.0 

.0560 

.0 

.0 

.0 

.0 

.0 

.0 ' 

.1382 

.0 

.0 

.0 

.0 

.0 

.0 

.2014 
.0 • 
.0 
.0 

.b 

.0 

.0 , 
.2064 



.0 ' 

.0 

.0 

.0 

.,0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0113 
.0113 
.0113 
.0113 
.0113 
.0113 
.0113 
.0673 
.067^ 
.0673 
.0673 
.0673 
.0673 
.0673 
.2055 
.2055 
.2055 
.2055 
.2055 
.2055 
.2055 
.4069 
.4069 
.4069 
.4069 
.4069 
.4069 
.4069 
. 6132 



.0000 

.0001 , 

.00029 

.0003 

.0006 

.,0009 

.0014 

.0019 . 

.0025 

.0033 

.0041 

.0050 

.0060 

.0071 

.0083 

.0095 

.0107 . 

.0120 

.0133 

.0146 

.0159 

.0172 

.0184 

.0196 

.0207^ 

.0218 

.0228 

.0237 " 

.0245 

.0252 

.0258 

.0263 

.0267 

.0270 

.0272 

.6273 

.0272 

.0271 

.0268 

.0265 

.0260 

.0255 

.0249 

.0242 

.0234 

.0226 



.0000 

.0001 

.0002 

.0006 

.0012 

.0021 • 

.0034 

.0053 

.0079 

.0111 

.0152 : 

.0202 

.0263 

.0334 

.0417 ^ 

.0512 

,0619 

.0739 

.0873 

.1019 

.1178 

.1349 

.1534 

.1729 

.19^7 

.2155 

.2383 

.2619 

.2864 

.3117 - 

.3375 

.3638' 

.3906 

.4176 

.4448 

.4721 

.4994 

,5^53^. 

.5798 

.6058 

.6313 

.6562 

.6804 

.7039 

.7265 



.0000 
.0000 
.0000 
.0000 
.0000 
.0000 
.0000 
.0000 
.0000 
.0000 
-.0000 
.0001 
.0002 
.0003 
.0004 
.0007 
.0009 
.0012 
.0016 
.0022 
.0032 
.0049 
.0079 
.0127 
.0194 
.0277 
.0368 
.0455 
.0526 
.057^ 
.0590 
.0582 

'.0551 
.0504 

>'0448 
.0338 
.0333 
.0288 
.0255 
.0232 
.0213 
.0193 
.0171 
.0148 
.0131 
.0125 



.OOOiO 
.0000 

;oooo, 

.0000 
.0000 
.0000 
.0000 
.0000 
.0000 
.0000 
.0001 
.0002 
.0003 
.0006 
.0010 
.0017 
.0026 
.0039 
.0055 
.0077 
.0109 
.0158 
.0238 
.0365 
.0558 
.0835 
.1203 
.1657 
.2184 
.2756 
.3346 
.3928 
.4479 
.4983 
.5431 
.5820 
.6153 
.6441 
.6696 
.6928 
.7140 
.7334 
.7504 
.7653 
.77*14 
.7909 



.0000 
.0 

.0 " 

f • 

.0 

.0000 
.0000 
.0000 
.0001 
.0001 
.0002 
i0003 
.0003 
.0006 
.0008 
.0012 
.0014 
.0017 
.0025 
.0029 
.0035 
.0044 
.0059 
.0066 
.0078 
.0091 
.0107 
.0116 
.0128 
.0151 
.0167 
.0183 
.0202 
.0208 
.0229 
.0248 
.0244 
.0264 
.0275 
.0274 
.0292 
.0288 
.0290 
^.Q298 
.0302-- 
.J5291 



.0000 
.0000 
.0000 
.0000 
.0000 
.0000 
.0000 
.0001 
.0002 
.0002 
,0004 
.0007 
.0010 
.0015 
.0024 
.0035 
.0050 
.0067 
.0092 
,.0121 
.0156 
.0201 
.0260 
.0325 
.0404 
.0494 
.0601 
.0717 
.0846 
.0996 
.1163 
.1346 
.1549 
.1757 
.1986 
.2234 
.2478 
.2742 
.3017 
.3291' 
.3583 
.3872 
.4161 
.4459 



ITEM SAMPLE f 3 CONTINPEB--, 



LINEAR 
PBEDICTION 



NEGATIVE 
HYPERCEdMETRIC 



- GUESSING 
FREE 



FREQUENCY 
DISTRIBUTION 



ERIC 



::ore 


Prop. 


Cum. 


Propt 


Cum. 


Prop • 


Cum. 


Prop. 


Cum. 






Prop • 




Prop. 




Prop. 




Prop. 


'}6 


.0 


.6132 


.0217 


.7483 


.0130 


.8039 


.0299 


.5351 


hi 


nO 


.61S2 


.0208 


.7691 


.0143 


,..•8182 


.0285 


.5635 


A8 


- ..0 


. 6132 


. 0199 


.7890 


. 0157 


•8339 


.0278 


.5913 


49 


.0 . 


.6132 


. .0189 


.8078 


0167 


. 8507 


.0277 


.6190 


50 


- .0 


.6132 


.0179 


.8257 


ol70 


.8677 


.0263 


.6453 


51 


• 0 


. 6132 


.0168 


8425 


.0166 


.8843 


.0249 


.6702 


52 


. .1653 


. 7785 


.0158 


8583 


0155 


8998 


k0244 

. VX*~f "T 


.6946 


53 


.0 


.7785 


.0148 


.8731 


. 0139 


.9137 
.9254 ^ 

. 7" 


.0233 


.7179 


54 


.0 


.77ff5 


.0137 


8869 


.0117 


.0221 


.7399 


55 


.0 


. 7785 


.0127 


8996 

. v/7 7 V 


.0092 


.9$46 


• .0216 


.7615 


56 


.0 


.7785 


.0117 


9113 

.. 7XX*^ 


^ .0067 


.9413 


.0201 


.7816 


57 


.0 


.7785 


01 OR 


9221 


} .0045 


.9458 


.0191 


% 8007 


5& 


.0 


.7785 ♦ 


OOQR 

. \/\/7w 


9320 


0029 


• .9487 


* .0177 


.8133 


59 


.0 


.7785 ' 


. 0089 


9409 

. 7*tvr^ 


- r ,0018 ^ ^ 


.^505 


-0159 


.8342 


60 


.1068. 


.8853 


.0081 


.9490 


.0013 


' .9518 


'.0153 


.8496 


61 


.8c 


.8853 


.0073 


9562 


.0013 


.9531 " 


.0149 


.8645 


•62:^ 


.0 


.8853 


.0065 


.9627 


V ,0016 


.9547 


rf0136 


.8781 


£3 


.0 


. 8853 


.0057 


.9684 


.0020 


.9567 


".0125 


.8905 


64 


.0 ' 


.8853 


.0051 

. WV^X 


.9735 


. 0622 


i 9589 


.0113 


.9019 


65 


.0 


.885 J 


.0044, 


.9779 

. 7 ' ' 7 


.0023 


.9612 


.0110 


.9129 


66 


.0 


.8853 • 


.0039 

. W^7 


.9818 


*j0024 


.9637 -> 


.0100 


.9223 


67 


.0603 


' .^457 


0033 


9851 


__,^028" 


- .9665 


.0095 


• .9324 


68 


.0 


.9457 


.0028 


-.9879 

. 7U r ^ 


.0633 ' 


* .9698 


.0084 


.9408 


69 


.0 


.9457 


. 0024 


9903 


^0038 


>• 9736 


tOd77 


.9485 


70 


.0' 


.9457 


0020 


9924 


003i9 

. V/V/^7 


9775 


.0068 


. 9553 


71 


.0 


.9457 


0017 

. \i vX 4 


9940 


. 0035 


.9810 


.0064 


.9618 
* r9671 


72 


.0 


.9457* 


0014 • 


9954 


.0026 


- .9836 


. 0053 


73 


.0 


.9457 


.0011 


.9965 


.,0017 


.9853 


.^052 


.9723 


74' 


.0295 


.9752 


.0009 

. Wv7 


.9974 

. 7 7 » " 


.0009 - 


-,9862 


.0047 


i9771 


/ J 


0 


9752 ' 


0007 


99R1 

. 77WX 


0004 


9866 

. 70 ' 


0040 


.9811 


76 


0 


9752 


000 s 


9986 

. 770\/ 


•t)064 


9870 


.0036 


.9847 


77 


0 


9752 


0004 


* 9991 

. 777X 


. 0007 


.9877 


.0030 


. 9877 


7R 


' 0 


Q7S2 


OOO^ 


9994 

. 7*f7*i 


0011 


9R8R 


0027 


.9905 


7Q 


n 




0002 


9Q96 ' 


0014 


9902 


0021 


9926 




.0 


.9752 


0002 


9997 / 


.0017 


. 9^20 


. 0020 


.9945 


81 


.0168 


.9921 


:oooi 


.9998/ 


. .0018 ' 


.9937 


.0015 


.9960 


82 


.0 


.9921 


.ODOl- 


.9999 


.0014 


.9952 


.0012 


.9973 


83 


.0 


.9921 


.0000 


1.0000 


.0009 


.':^960. 


.0010 


.9983 


84 ^ 




.9921 


.0000 


i.odoo 


..0004 


.9964 


.0007 


.9989 


85 


.0 


.9921 


.0000 ■ 


1.0000 


.0007 


".9971 


• 0004 


.9994 


86* 


.0 


.9921 


. .0000 


1.0000 


.0009 


.9980 


• .0002 


.9996 


87 


.0^ 


.9921 


.0000 


1.0000 


.0005 


.9985 


.0002 


.9998 


8d 


r0079 


1.0000 


.0000 


1.0000 


.0001 


- .9986 


.0001 


.9999, 


89 


.0 


1.0000 


.0000 


1.0000 


.0006 . 


, .^992 


.0001 


1:0000 


90 


.0 


1.0000 


.0000 


1.0000 


*^0d8 


1.0000 


.0 


1.0000 



RESULTS fpR ITEM SAMPLE # 4 



LINEAR NEGATIVE GUESSING -^FREQUENCY 
PREDICTION HYPERGEOMETRIC FREE ^ DISTRIBUTKMJ 
- Cunu- ■ Cumu- Cumu- Cumu- 
lative lative latlve latlve 
Score Proper- Propor- Proper-- Proper- Proper- Proper- Propor- Propor- 
tlon tlon tlon tlon tlon tlon tlon tlon 



0 .0 .0 .0000 .0000 .0000 .0000 .0000 .0000 

1 .0 iO ^ .0000 .0000 .0000 .0000 .0 .0000 

2 .0 .0 .0000 .0000 .0000 .0000 .0 .0000 
- 3 .0 .0 .0000 .0000 .0000 .0000 . .6 .0000 

* .0 „ .0 .0000 .0000 .0000 .0000 .0 .0000 

5 .0 .0 , .0000 .0000 .0000 .0000 .0000 .0000 

6 .0 .0 ' .0000 ,0000 .0000 .0000 .0000 .0000 

7 .0 .0 .0000 .0000 .0000' .0000 .0000 . .0001 

8 .0 .0 .0000 .0000 .0000 .0000 .0001 .0002 

9 . .0 ,0 , .0000 .0001 .0001 .0001 .0001 .0002 

10 .0 .0 .0001 .0002 .0001 .0002 .0002 v .0004 

11 .0 .0 .0001 .0003 .0002 .0004 .0003 .0007 

12 ,0027 .0027 .0002 .0004 .0004 .0008 .0003 .0010 

13 .0 .0027 .0002 .0007 .0006 .0014 .0006 .0015 

14 .0 .0027 .0003 .0010 .0008= .0022 .0008 .0024 

15 ,0 .0027 .0005 . .0015 .0011 .0033 .0012 i0035 

16 - .0 .0027 .0007 .0022 .0013 .0046 .0014 .0050 

17 .0 . .0027 .0009 .0031 .0015 .0061 .0017 .0067 
IS .0 .0027 .0012 .0042 .0016 .0078 .0025 .0092 

19 .0152^^ .0179 ' .0015 .0057 .0017 .0094 .0029 .0121 

20 .0 .0179 .0019 .0077 .0016 .0110 .0035 .0156 

21 .0 .0179 ;0024 .0101 .0015 .0125 .0044 .0201 

22 .0. .0179 ,.0030 .0130 .0013 .0138 .0059' .0260 

23 .0 .0179 .0036 .0167 .0011 o .QISO .0066 ' .0325 

24 -.0 . 0179 . 0044 . 0210 .OOlO .0159 . 0078 . 0404 

25 . 0433 ,0612 . 0052 . 0262 . 0009 ';'0168 . 0091 .0494 

26 .0 - .0612 . 0062 , .0324 .0009 .0177 .0107 .0601 

27 .0 .0612 .0072 .0396 .0011 .0188 .0116 .0717 

28 .0 .0612 .0083 .0479 .0014 .0202 .0128 .0846 

29 • .0 .0612 .0095 .0575 .0018 .0220 ' .0151 - .0996 
50 . 0 -.0612 . 0108 . 0683 ..0024 . 0244 . 0167 .1163 

31 .1009 .1621 .0122 tO805^ iO032; ?0276 *0183 .1446- 

32 .0 .1621 .0137 .0942 .0046 .0322 .0202 .1549 
33^ .0 .1621 .0152 .1094 .0072 .0394 .0208, .1757 

34 - .0 — ' .1621 .0167 .1261 .0116 .0510 .0229 .1986 

35 .0 .1621, .01«3 .1444 .0182 .0692 .0248 .^234 

36 .0 .1621 i0199 .1643 .0267 .0960 .0244 .2478 

37 .0 .1621 .0214 .1857 .03.60 .1320 ^.0264 .2742 
38, .1605 . 3226 . 0230 . 2087 . 0443 .1763 . 0275 " .3017 
39' .0" .3226 .0245 .2331 .0496 .2259 ' .p274 .3291 

. 40 .0_ .3226 .0259 .2590 .0509 .2768 .0292 .3583 

41 ,g,.0 .3226 V0272 .2862 .0479 .3247 .0238 .3872 

42 .0 .3226 -.0284 .3146 .0416 .3663 .0290 .4161 

43 .0 - .3226 .0295 .3441 .0336 .3999 70298 .4459 

44 .,.1984 .5210 .0305 .3746 .0259 .4258 .0302 .4761 

45 .0 .5210 .0313 .4059 .0200 .4458 .0291 .5052 



ITEM SAMPLE # 4 OONTINOED 





LINEAR 


NEGATIVE 


GUESSING 


FREQUENCY 




PPEOICTION 


HYPERCTIOMETRIC 


FREE ' 


DISTRIBUTION 


Score 


Prop. 


Cum. 


Prop. 


Cum. 


Prop. 


Cum. 


Prop. 


Cum. 






Prop. 




Prop. 




Prop. 




Prop. 


46 


.0 


.5210 


.0319 


.4377 


.0168 


.4626 


.0299 


.5351 


47 


.0 


.5210 


. 0323 


.4700 


.0159 


;4785 


.0285 


.5635 


48 


.0 


.5210 


.0326 


.5026 


.0165 


.4950 


.0278 


.5913 


49 


.0 


.5210 


.0326 


.5352 


.0176 


.5126 


.0277 


.6190 


50 


.2007 


.7217 


.0325 


.5677 


.0188 


.5314 


.0263 


.6453 


51 


.0 


.7217 


.0321 


.5998 


.0208 


.5523 


.0249 


.6702 


52 


.0 


. 7217 


.0316 


.6314 


.0250 


.5773^ 


.0244 


.6946 


53 


.0 


.7217 


.0309 


.6623 


.0318 


.6091 


.0233 


.7179 


54 


.0 


.7217 


.0300 


. .6922 


.0403 


.6494 


.0221 


.7399 


55 


.0 


.7217 


.0289 


.7212 


.0480 


.6974 


.0216 


.7615 


56 


.0 


.7217 


.0277 


.7489 


.0522 


. 7496 


.0201 


.7816 


57 


.1523 


.8740 


.0264 


.7753 


.0515 


.8011 


.0191 


.8007 


58 


.0 


.8740 


.0249 


.8002 


.0463 


.8474 


.0177 


• .8183 


39 


.0 


.8740 


.0234 


.8236 


.0381 


.8855 


.0159 


.8342 


60 


.0 


.8740 


.0218 


.8454 


.0290 


.9145 


.0153 


.8496 


61 


.0 


.8740 


.0202 


.8656 


.0208 


.9354 


.0149 


.8645 


62 


.0 


.8740 


.0185 


.8841 


.0146 


.9499 


. 0136 


.8781 


63 


.0863 


.9603 


.0168 


.9009 


.0103 


.9603 


.0125 


.8905 


64 


.0 


.9603 


.0151 


.9160 


*0O77 


.9680 


.0113 


.9019 


65 


.0 


.9603 


.0135 


.9295 


.0059 


.9739 


.0110 


.9129 


66 


.0 


.9603 


.0120 


.9415 


.0045 


.9784 


.0100 


.9228 


67 


.0 


.9603 


.0105 


.9520 


.0034 


.9819 


.0095 


.9324 


68 


.0 


.9603 


.0091 


.9610 


.0026 


.9845 


.0084 


..9408 


69 


.0327 


.9930 


.0078 


.9688 


.0022 


.9867 


.0077 


.9485 


70 ' 


.0 


.9930 


.0066 


.9754 


.0019 


.9886 


.0068 


.9553 


71 




.9930 


.0055 


.9808 


.0016 


.9902 


.0064 


.9618 


72 


.0 


.9930 


.0045 


.9853 


.0013 


.9914. 


.0053 


.9671 


73 


.0 


.9930 


.0036 


.9890 


.0011 


.9925 


.0052 


.9723 


74 


.0 


.9930 


.0029 


.9919 


.0012 


.9937 


.0047 


.9771 


75 <^ 


.0 


.9930 


.0023 


.9942 


.0012 


.9949 


.0040 


.9811 


76 


.0070 


1.0000 


.0017 


.9959 


.0011 


.9960 


.0036 


.9847 


77- 


_Q 


1.0000^ 


.0013 


.^972 ~ 


j«009 


—.9969 


.0030 


.9877 


78 


.0 


1.0000 , 


.0009 


.9981 


.0008 


.9977 


.0027 


.9905 


79 


.0 


1 1.0000 


.0007 


.9988 


.0006 


.9982 


.0021 


.9926 


80 


.0 


X. OOUu 


.0003 




. 0Q03 


.99oo 






81 


.0 


1.0000 


.0003 


.9996 


.0002 


.9987 


.oois 


.9960 


82 


.0 


1.0000 


.0002 


.9998 


.0001 


.9988 


.0012 


.9973 


83 


.0 


1.0000 


.0001 


.9999 


.0001 


.9989 


.odio 


.9983 


84 


.0 


1.0000 


.0001 


.9999 


.0000 


.9989 


.0.007 


.9989 


85 


.0 


1.0000 


.0000 


1.0000 


.0002 


.9991 


.0004 


.9994 


86 


.0 


1.0000 


.0000 


1.0000 


.0004 


.9995 


.)6002 


.9996 


87 


.0 


1.0000 


.0000 


1.0000 


.0003 


.9997 


.0002 


.9998 


88 


.0 


1.0000 


.0000 


1.0000 


.0001 


.9998 


.0001 


.9999 


89 


.0 


1.0000 


.0000 


1.0000 


.0001 


.9999 


,.0001 


1.0000 




.0 


1.0000 


.0000 


1.0000 


.0001 


1.0000 


.0 


1.0000 



RESULTS fOR ITEM SA^IPLE I 5 



LINEAR NEGATIVE GOESSING FREQUENCY 

PREDICTION HY?ERGEOMETRIC FREE DISTRIBUTION 







Cumu— 




Cumu- 




Cumu- 




Cumu- 






latlve 




lative 




lative 




lative 


Score 


Propor- 


Propor- 


Propor- 


Propor- 


Propor- 


Propor- 


Propor- 


Propor- 




tion 


tion 


tion 


tion 


tion 


tion 


tion 


tion 


0 


.0 


.0 


.0000 


.0000 


- 

.0000 


^0000 


.0000 


.0000 


1 


.0 


.0 


.0000 


.0000 


.0000 


.0000 


.0 


.0000 


2 

• ^ 


.» 


.0 


.0000 


.0000 


.0000 


.0000 


.0 


.0000 




.0 


.0 


.0000 


.0000 


' .0000 


.0000 


.0 


.0000 


% . 


.0 


.0 r 


.oooa 


. ' Toooo 


.0000 


.0000 


.0 


»0000 


5 


.0 


.0 


.0000 


' .0000 


.0000 


.0000 


.0000 


.0000 


6 


.0 


.6; 


.0000.- 


.0000 


.0000 


.0000 


.0000 


.0000 


7 


.0 


.0 


.0000 


.0001 


.0000 


.0000 


.0000 


.0001 


8 


.0 


.0 


.0001 


.0001 


.0000 


.0000 


.0001 


.0002 


9 


.0 


.0 


.0001 


.'Cf002 


.0000 


.0000 


.0001 


.0002 


10 


.0 


.0 


.0001 


.0004 


.0001 


.0001 


.0002 


.0004 


11 


.0017 


.0017 


.0002 


.0006 


' .0001 


.0002 


.0003 


.0007 


12 


.0 


.0017 


.0003 


.0009 


.0002 


.0004 


.0003 


.,0010 


13 


.0 


.0017 


.0004 


.0013 


.0003 


.C006 


.0006 


.0015 


14 


.0 


.0017 


.0006 


.0019 


.0004 


.0010 


.0008. 


.0024 


15 


.0 


.0017 


.0008 


.0027 


.0006 


.0016 


.0012 


.0035 


16 


.0 


.0017 


.0011 


.0038 


.0007 


.0023 


.0014 


.0050 


' 17 


.0154 


.0171 


.0014 


.0052 


.0009 


.0032 


.0017 


.0067 


18 


.0 


.0171 


.0018 


.0069 


.0010 


.0042 


.0025 


.0092 


19 


.0 


.0171 


.0022 


.0091 


.0012 


.0054 


.0029 


.0121 


20 


.0 


.0171 


.0027 


.0118 


.0013 


.0067 


.0035 


.0156 


21 


.0 


.0171 


.0033 


.0151 


.0015 


.0081 


.0044 


.0201 


22 


.0 ' 


.0171 


.0040 


.0191 


.0016 


.0098 


.0059 


.0260 


23 


.0 


.0171 


.0047 


.0239 


.0018 


.0116 


.0066 


.0325 


24 . 


.0460 


.0631 


.0056 


.0295 


.oo'ii 


.0137 


.0078 


.0404 


25 


.0 


.0631 


.0065 


.0360 


.6024 


.0161 


.0091 


.0494 


26 


.0 


.0631 


.0075 


.0435 


.0027 


.0189 


.0107 


.0601 


27 


.0 


.0631 


.0086 


.0521 


.0031 


.0220 


.0116 


.0717 


28 


.0 


.0631 


, ■ .0098 


.0619 


.0035 


..0254 


.0128 


.0846 


29 


.0 


.0631 


.0110 


.0730 


.0037 


.0291 


.0151 


.0996 


30 


.0 


.0631 


.0123 


— H)853^ 


.0038 


- .0329 


.0167 


.1163 


31 


.0965 


.1597 


.0137 


.0990 


.0037 


. .0366 


.0183 


.1346 


32 


.0 


.1597 


.0150 


;1140 


.0039 


.0405 


.0202 


.1549 


33 


.0 


.1597 


.0165 


.1305 


.0045 


.0450 


.0208 


.1757 


34 


.0 


.1597 


.0179 


.1483 


.0063 


.0513 


.0229 


.1986 


35 


.0 


.1597 


.0193 


.1677 


.0096 


.0610 


.0248 


.2234 


36 


.0 


.1597 


.0207 


.1884 


.0149J1 


.0758 


.0244 


.2478 


37 


.1767 


.3364 


.0221 


.2105 


.0220 ' 


.0978 


.0264 


.2742 


38 


.0 


.3364 


.0234 


.2339 


.0303 


.1281 


.0275 


.3017 


39 


.0 


.3364 


.0247 


.2586 


.0387 . 


.1668 


.0274 


.3291' 


40 


.0 


.3364 


.0259 


.2845 


.0460 f- 


.2128 


.0292 


.3583 


41* 


.0 


.3364 


.0270 


.3114 


.0510 


' .2638 


.0288 


.3872 


42 


.0 


.3364 


.0280 


.3394 


.0530, 


.3168 


.0290 


.4161 


43 


. .0 


.3364 


.0288 


.3682 


.0523 


.3692 


.0298 


.4459 




.2125 


.5489 


.0296 


.3978 


.0501 


.4192 


.0302 


.4761 


!ir5 


.0 


.5489 


.0301 


.4279 


, .0473 


.4665 


.0291 


.5052 



LINEAR NEGATIVE GUESSING FREQUENCY 

PREDICTION HYPERGEOMETRIC FREE DISTRIBUTION 



Score 


Prop. 


Cum. 
Prop. 


Prop. 


Cum. 
Prop. 


Prop. 


Cum. 
Prop. 


Prop. 


Cum. 
Prop. 


46 


.0 


.5489 


.0306 


.4585 


.0447 


.5112 , 


.0299 


.5351 


47 


.0 


.5489 


.0308 


.4893 


.0421 


.5533 


.0285 


.5635 


48 


.0 


.5489 


.0310 


.5203 


.0392 


.5925 


.0278 


.5913 


49 


.0 


.5489 


.0309 


'15512 


.0357 


.6282 


.0277 


.6190 


50 


.0 


.5489 


.0307 


.5819 


.0323 


.6604 


.0263 


.6453 


51 


.1907 


.7396 


.0303 


.6122 


.0297 


.6902 


.0249 


. 6702 


52 




.7396 


.0298 


.6419 


.0284 


.7185 


.0244 


.6946 


53 


.7396 


.0291 


.6710 


.0277 


.7462 


' .0233 


.7179 


54 


.0 


.7396 


.0282 


.6992 


.0264 


.7727 


.0221 


.7399 


55 


.0 


.7396 


.0272 


.7264 


.0240 


.>966 


.0216 


.7615 


56 




.7396 


.0261 


.7525 


.0206 


.8173 


.0201 


.7816 


57 


.o\ 


.7396 


.0249 


.7775 


.0176 


.8349 


.0191 


.8007 


58 


.14l« 


.8814 


.0236 


.8011 


.0161 


.8510 


.0177 


.8183 


59 


.0 \ 


.8814 


.0222 


.8233 


.0161 


.8671 


.0159 


.8342 


60 


^ .0 


s .8814 


.0208 


.8442 


.0165 


.8836 


.0153 


.8496 


61 


.0 


.8814 


.0193 


.8635 


.0165 


.9000 


.0149 


.86^45 


62 


.0 


.8814 


.0178 


.8813 


.0156 


,9156 


/.iil36 


.8781 


63 


.0 


.8814 


.01^*3 ~ 


.8976 


.0141 


i 9297 


.6125 


.8905 


64 


.0785 


.9599 


.014^ 


.9124 


.01?2 


.9419 


.0113 


.^019 


65 


.0 


.9599 


.0133 


.9258 


.0102 


.9521 


.Olio 


.9129 


66 


.0 


.9599 


.0119 " 


.9377 


.0084 


.9605 


.0100 . 


.9228 


67 


.0 


. .9599 


.0105 


.9482 


.0070 


.9675 


.0095 


.9324 


68 


.0 


.9599 


.0092 


.9575 


.0059 


.9734 


.0084 


.9408 


69 


.0 


.9599 


.0080 


.9655 


.0051 


.9785 


.0077 


.9485 


70 


.0 


.9599 


.0069 


.9723 


.0042 


.9827 


.0068 


.9553 


71 


.0313 


.9912 


.0058 


.9781 


.0032 


.9859 


.0064 


.9618 


72 


.0 


.9912 


.0048 


.9830 


.0022 


.9881 


.0053 


.9671 


73 


.0 


.9912 


.0040 


.9870 


.0016 


.9897 


.0052 


.9723 


74 


.0 


.9912 


.0032 


.9902 


.0013 


.9910 


.0047 


.9771 


75 


.0 


.9912 


.0026 


.9928 


.0012 


.9922 


.0040 


.9811 


76 


.0 


.9912 


.0020 


.9948 


.0011 


.9933 


.0036 


.9847 


77 


.0 


.9912 


.0016 


i9964 


.0010 


.9943 


.0030 


.9877 


78 


.0038 


1.0000 


.0012 


.9975 


.0008 


.9951 


.0027 


.9905 


79 


.0 


1.0000 


.0008 


.9984 


.0007 


.9958 


.0021 


.9926 


80 


.0 


1.0000 


.0006 


.9990 


.0004 


.9962 


.0020 


.9945 


81 


.0 


1.0000 


.0004 


.9994 


.0003 


.9964 


.0015 


.9960 


82 


.0 


1.0000 


.0003 


.9996 


.0003 


.9967 


.0012 


.9973 


83 


.0 


1.0000 


.0002 


.9998 


.0002 


.9969 


.0010 


.9983 


84 


.0 


1.0000 


.0001 


.9999 


.0001 


.9971 


.0007 


,9989 


85 


.0 


1.0000 


.0001 


1.0000 


.0004 


,9975 


.0004 


.9^94 


86 


.0 


1.0000 


.0000 


1.0000 


.0008 


.9983 


.0002 


.9996 


87 


.0 


1.0000 


.0000 


1.0000 


.0006 


.998* 


.0002 


.9998 


88 


.0 


1.0000 


.0000 


1.0000 


.0002 


.9990 


.0001 


.9999 


\89 


^0 


1.0000 


.0000 


i.ooob 


.0005 


.9995 


.0001 


1.0000 


, ap 


.0 


1.0000 


.0000 


1.0000 


.0005 


1.0000 


.0 


1.0000 



RESULTS FOR ITEM SAMPLE # 6 



LINEAR NEGATIVE GUESSING FREQIJENCT 

PREDICTION ^ HYPERGEOMETRIC FREE * DISTRIBUTION 







Cuisu** 




Cumu- 




Cvtnu- 




Cumu- 


Score 




latlve 


1 

i 


lative 




lative 




lative 


Prbpor- 


Propor- 


Propor- 


Propor- 


Propor- 


Propor- 


Propor- 


Propor" 




tlon 


tion 


tion 


tion 


tion 


tion 


tion 


tion 


0 


.0 


.0 


.0000 


.0000 


.0000 


.0000 


.0000 


.0000 


1 


.0 


.0 


.0000 


.0000 


.0000 


.0000 


.0 


,0000 


2 


.0 


.0 


.0000 


.0000 


.0000 


.0000 


.0 


.0000 


3 


.0 


.0 


' .0001 


.0001 


.0000 


.0000 


.0 


.0000 


4 


.0 


.0 


.0001 


.0002 


.0000 


.0000 


.0 


.0000 


5 


.0 


.0 


.0002 


.0004 


.0000 


.0000 


.oopo 


.0000 


6 


.0 


.0 


.0003 


.0007 


.0000 


.0000 


.0000 


.0000 


7 


.0 1 


.0 


.0004 


.0011 


.0000 


.0000 


.0000 


.0001 


8 


.0 


.0 


.0006 


.0017 


.0000 


.0000 


.0001 • 


: .0002 


9 


.0 


.0 


.0008 


.0025 


.0000 


.oooTo 


.0001 


\.0002 


10 


. 0052 


.0052 


-0011 




0001 


0001 


0002 - 


\ 0004 


11 


.0 


.0052 


.0014 


.0051 


.0001 


.0002 


.0003 


JQO07 


12 


.0 


.0052 


.0018 


.0068 


, ^ .0002 


.0005 


.0003" 


.obio 


13 


.0 


.0052 


.0022 


.0091 


.0004 


.0009 


.0006 


.0015 


14 


.0 


.0052 


.0027 


.0118 


.0007 


.0015 


.0008 


.0024 


15 


.0 


.0052 


.0033 


.0150 


.0010 


.0025 


.0012 


I- »0035 


16 


.0 


.0052 


' i0038 


.0189 


.0014 


.0039 


.0014 


.0050 


17 


.0285 


.0337 


.0045 


.0234 


./)018 


.0057 


.0017 


.0067 


18 


.0 


.0337 


.0052 


.0286 


j0024 


.0081 


.0025 


.0092 


19 


.0 


.0337 


.0060 


.0345 


J0030 


.0112 


.0029 


.0121 


20 


.0 


.0337 


.0068 


.0413 


j0038 


.0149 


.0035 


.0156 


21 


.0 , 


.0337 


.0076 


.0489 




.0196 


.0044 


.0201 


22 


.0 


.0337 


.0085 


.0574 


.0057 


.0254 


V .0659 


.0260 


23 


.0 


.0337 


.0094 


.0668 


.0069 


.0323 


.0066 


.0325 


24 


.0670 


.1007 


.0103 


.0771 


.0082 


.0405 


.0078 


.0404 


25 


.0 


.1007 


.0113 


.0884 


.0096 


.0501 , 


.0091 


.0494 


26 


.0 


.1007 


.0123 


.1007 


.0110 


.0610 


.0107 


.0601 


27 


.0 


.1007 


.0133 


.1139 


.0122 . 


.0733 


.0116 


.0717 


28 


.0 


.1007 


.0143 


.1282 


.0131 


.0863 


.0128 


.0846 


29. 


. .0 


.1007 


. .0153 


.1435 


.0136 


. 0999 


.0151 


.0996 


30 


.0 


.1007 


.0162 


.1597 


.0J.37 


.1137 


.0167 


.1163 


31 


.0 


.1007 


.0172 


.1769 


.0139 


.1276 


.0183 


.1346 


32 


.1319 


.2326 


.0181 


.1950 


.0144 


.1419 


.0202 


.1549 


33 


.0 


.2326 


.0190 


.2140 


.0155 


.1574 


.0208 


.1757 


34 


.0 


.2326 


.0199 


.2340 


. .0173 


.1948 


.0229 


.1986 


35 


.0 


.2326 


.0207 


.2547 


.0196 


.1943- 


.0248 


.2234 


36 


.0 


.2326 


.0215 


.2762 


.0220 


.2163 


.0244 


.2478 


37 


.0 


.2326 


.0222 


.2984 


.0245 


.2408 


.0264 


.2742 


. 38 


.0 


.2326 


.0229 


.3213 


.0273 


.2682 


.0275 


.3017 


39 


.1734 


.4060 


.0235 


.3448 


.0307 


.2988 


.0274 


.3291 


40 


.0 


.4060 


.0240 


.3688 


.0347 


.3335 


.0292 


.3583 


41 


iO 


.4060 


.0244 


.3932 


.0391 


.3726 


.0288 


.3872 


42 


.0 


.4060 


.0248 


.4180 


.0435 


.4160^ 


.0290 


.4161 


43 


.0 


.4060 


.0251 


.4431 


.0472 


.4632 


.0298 


.4459 


O 44 


.0 


.4060 


.0253 


.4684 


.0496 


.5128 


.0302 


-.4761 


ERICAS 


.0 


.4060 


.0254 


.4938 


.0501 


.5629 


.0291 


.5052 



ITEM SAMPLE # 6 CONTINIIED 



J 



LINEAR NEGATIVE GUESSING FREQUENCY 

PREDICTION HYPERGEOMETRIC FREE DISTRIBUTION 

Score Prop. Cum. Prop. Cum. Prop. Cum. Prop. Cum. 

Prop. Prop. Prop. Prop. 



46 


.1909 


.5969 


47 


.0 


.5969 


48 


.0 


.5969 


49 


.0 


.5969 


50 


.0 


. 5969 


51 


.0 


.5969 


52 


.0 


.5969 


53 ' 


.1555 


.7524 


54 


.0 


.7524 




.0 


.7524 


^6 


.0 


.7524 


57 


.0 


.7524 


58 


.0 


.7524 


59 


.0 


.7524 


60 


.1154 


.8678 


61 


.0 


.8678 


62 


.0 


.8678 


63 


.0 


.8678 


64 


.0 


.8678 


65 


.0 


.8678 


66 


.0 


.6678 


67 


.0749 


.9428 


68 


.0 


.9428 


69 


.0 


.9428 


70 


.0 


.9428 


71 


.0 


.9428 


72 


.0 


.9428 


73 


.0 


.9428 


74 


.0423 


.9851 


75 


.0 


.9851 


76 




.9851 


77 




^ .9851 


78 




.9851 


79 




.9851 


, 80 




.9851 


81 


V0149 


1.0000 


82 




1.0000 


83 




1.0000 


84 




1.0000 


85 




1.0000 


86 


!o\ 


1.0000 


87 


.0 


1.0000 


88 


.0 


1.0000 


89 


.0 


1.0000 


O 90 


.0 


1.0000 



.02S4 


.5193 


.0483 


.0254 


.5446 


.0440 


.0253 


.5699 


.0377 


«0250 


.5949 


.0304 


.P247 


.6197 


;0237 


.0243 


.6440 


.0186 


.0239 


.6679 


.0155 


.0233 


.'6912 


.0138 


.0227 


.7139 


.0127 


.0220 


.7359 


.0113 


.0213 


.7572 


.0093 


.0205 


.7777 


.0069 


.0196 


.7973 


.0047 


.0187 


.8161 


.0031 


' .0178 


.8339 


.0024 


.0168 


.8507 


.0029 


.0159 


.8666 


.0042 


.0149 


.8814 


.0057 


.0138 


.8953 


.0067 


.0128 


.9081 


.0069 


.0118 


.9199 


.0069 


.0108 


.9307 


.0076 


.0098 


.9406 


.0097 


.0089 


.9495 


.0133 


.0080 


.9574 


.0169 


..0071 


.9645 


.0185 


.0062 


.9708 


.0168 


.0054 


.9762 


.0127 


.0047 


.9809 


.0082 


.0040 


.9849 


.0047 


.0034 


.9883 


.0026 


.0028 


.9911 


.0016 


.0023 


.9933 - 


.0012 


.0018 


^9952 


.0013 


.0014 


.9966 


.0015 


.0011 


.9977 


.0014 


.0008 


.9985 


.0010 


.0006 


.9991 


.0005 


.0004 


.9995 


.0002 


.0003 


.9997 


.0005 


.0002 


.9999 


.0006 


.0001 


1.0000 


.0003 


.0000 


1.0000 


.0001 


.0000 


1.0000 


.0001 


.6000 


1.0000 


.0004 



.6113 


.0299 


.5351 


.6553 


.0285 


.5635 


. 6930 


.0278 


.5913 


.7234 


.0277 


.6190 


.7470 


.0263 


.6453 


.7656 


.1249 


.6702 


.7811 


.0244 


.6946 


.7949 


.0233 


.7179 


.8076 


.0221 


.7399 


.8188 


.0216 


i7615 


.8281 


.0201 


.7816 


.8350 


.0191 


.8007 


.8398 


.0177 


.8183 


.8428 


.0159 


.8342 


.8452 


.(a.53 


.8496 


.8481 


.0149 


.8645 


.8524 


.0136 * 


.8781 


.8581 


.0125 


i8905 


.8647 


.0113 


.9019 


,8716 


.Olio 


.9129 


.8785 


.0100 


.9228 


.8861 


. 0095 


.9324 


.8953 


.0084 


.9408 


. 9091 


. 0077 


. 9485 


.9260 


.0068 


.9553 


.9445 


.0064 


.9618 


.9612 


. 0053 


.9671 


.9739 


.0052 


.9723 


.9822 


.0047 


.9771 


.9869 


.0040 ". 


.9811 


.9895 


.0036 


.9847 


.9911 


.0030 


.9877 


.9923 


.0027 


.9905 


.9936 


.0021 


.9926 


.9951 


.0020 


.9945 


.9965 


.0015 


.9960 


.9975 


.0012 


.9973 


.9979 


/ .0010 


.9983 


.9981 


.0007 


.9989 


.9986 


.0004 


-.9994 


.9991 


.0002 


.9996 


.9994 


.0002 


.9998 


.9995 


.0001 


.9999 


.9996 


.0001 


1.0000 • 


1.0000 


.0 * 


r.oooo 



RESULTS FOR ITEM SAMPLE # 7 



LINEAR ^ NEGATIVE GUESSING FilEQUENCY 

PBEDICTION HYPERffiOMETRIC FREE DISITIIBUTION 

GuBiu- • Cumu- Cuniu*- Ctami- ■ 
latlve latlve latlve latlve 
Score Proper- Propor- Proper- Proper.- Propor- Proper- Proper- Prepor- 
tlon tlen tlon tlen . tlon tlen tlon tlon 

0 .0 .0 .0001 .0001 .0000 .0000 .onoo .0000 

1 .0 .0 .0002 .0003 .0000 .0000 .0 .0000 

2 .0 .0 .0005 .0007 .0000 .0000 -0 .0000 

3 .0 .0 .0008 .0015 .0000 .0000 .0 .0000 
A .0 .0 .OOia .0029 .0000 .0000 .0 .0000 

5 . 0 . 0 . 0020 . 0048 * 0000 .(JWO .0000 .0000 

6 .0 .0. .0027 ^ .0075" .0000 .OOQO .0000 .0000 

7 .0 .0 .0036 .0111 .0001 .0001 ' .0000 .0001 

8 .0 .0 .0046 .0157 .0002 .0004 .0001 .0002 

9 .0 .0 .0056' .0213 J0006 .0009 .0001 .0002 

10 .0 .a ' .0068 .0281 .0012 ^-^021 .0002' .0004 

11 .0 .0 .0080 .0361 .0023 .oSH* .0003 ;0007 

12 .0 .0 .0093 .0454 .0039 .0083 .0003 .0010 

13 .0 .0 .0106 .0560 *0062 .0145 .0006 .0015 

14 .0 .0 ,0119 .0679 .0091 .0236 .0008 .0024 

15 .0 .0 .0133 .0812 .0123 .0359 .0012 " .0035 

16 . 0 . 0 . 0146 . 0958 . 0154 ..0513 . 0014 .0050 

17 - .0 .0 .0159 .1117 ^ .0182 .0695 .0017 .0067 

18 .0 .0 .0172 .1^90 .0202 .0897 .0025 .0092 

19 .0251 .0251 .0185 .1474 .0212 .1109 .0029- .0121 
"20 .0 .0251 .0197 .1671 .0213 .1321 .0035 .0156 
■21 - .0 .0251 .0208 .1879 .0207 .1528 .0044 .0201 

22 .0 .0251 .0218 .2097 ,.0199 .1727 .0059 .026Q 

23 .0 .0251 .0228 .2324 .0196, .1923 .0066 .0325 

24 .0 .0251 .0236 .2561 ,0201 .2123 .0078 .0404 

25 .0 .0251 .0244 .2805 .0217 .2341 .0091 .0494 

26 .0895 .1146 .0251 *3055 .0246 .2587 .0107 .0601 

27 .0 .1146 .0256 .3312 .0285 .2872 .0116 .0717 

28 .0 .1146 .0261 .3573 .0330 .3202 .0128 .0846 
; 29 .0 .1146 .0265 .3837 .0374 .3577 .0151 .0996 

; 30 .0 .1146 .0267 .4104 .0413 .3990 .0167 .1163 

■ 31 .0 .1146 .0268 .4373 .0442 .4432 .0183 .1346 

32 .0 .1146 .02(S9 . 4642 . 0458 . 4890 . 0202 .1549 

33 .1571 .2716 .0268 .4910 .0459 .5348 .0208 .1757 

34 .0 .2716 .0266 .5176 .0444 .57^2 .0229 .1986 

35 .0 .2716 .0264 .5440 .0414 '.6206 .0248 .2234 

36 .0 .2716 .0260 .5700 .0372 .6578 .0244 .2478 

37 .0 .2716 .0256 , .5956 .0324 .6902 .0264 .2742 

38 .0 .2716 .0251 .6207 .0275 .7177 .0275 .3017 

39 .0 ♦ .2716 .0245 .6451 .0233 .7410 .0274 .329|. 

40 .1946 .4663 .0238 .6689 .0199 .7609 .0292 .3581 

41 .0 .4663 .0231 .6920 .0172 .7781 .0288 .3872 

42 .0 .4663 .0223 .7143 .0149 .7929 .0290 .4161 

43 .0 .4663 .0215 .7358 .0126 .8056 .0298 .4459 
.0 .4663 .0206 .7564 .0103 .8159 .0302. .4761 
.0 .4663 .0197 .7762 .0081 # .8240 .0291 .5052 



/ 
/ 



IlEM SAMPLE 9 7 C(»ITINDED . _ ' ' — 

LINEAR NEGATIVE GUESSING FREQUENCY- 

PREDICTION HYPERGEOMETtaC FREE DISTRIBUTION 

Scoxe Prop. Cum. Prop. Cum. Prop. Cum. Prdp. Cum. 

Prop. Prop. Prop. Prop. 



46 .0 .A663 .0188 .7949 .0062 .8302 .0299 .5351 

47 .1909 .6571 .0178 .8128 .0050 .8352 ,0285 . .5635 " 

48 .0 .6571 .0169 .8297 .0047 .8398 .0278 .5913 

49 .0 .6571 .01,59 .8456 .0052 .8451 .0277 .6190 

50 .0 .6571 .0150 .8606> .0062 .8512 .0263 .6453 

51 .0 .6571 .0140 .8746 .0071 .8583 .0249 .6702 

52 .0 .6571 .0130 .8876 .0076 .8659 .0244 ,.6946 

53 .0 .6571 .0121 .8997 .0079 .8738 .0233 .7179 

54 .1392 .7964 .0112 .9109 .0084 .8822 .0221 .7399 

55 .0 .7964 .0103 .9212 .0095 .8917 .0216 ;7615 

56 .0 .7964 .0095 .9307 .0111 .9028 .0201 .7816 

57 .0 .7964 .0086 .9393 .0128 • .9156 .0191 .8007 

58 ' .0 .7964 .0078 .9472 .0139 .9295 .0177 .8183 

59 .0 .7964 .0071 .9542 .0138 .9432 .0159 .8342 

60 .0 " .7964 .0064 .9606 .0124 .9556 .0153 .8496 

61 .0952 .8915 .0057 .9663 .0102 .9653 .0149 .8645 

62 .0 .8915 .0051 .9713 .0076 .9734 .0136 .8781 

63 .0 .8915 .0045 .9758 .0053 .9787 .0125 .8905 

64 .0 .8915 .0039 .9797 .0035 .9322 .OU? .9019 

65 .0 .8915 .0034 .9832 .0023 .9845 .0110 .9129 

66 - .0 .8915 .0030 .9861 .0017 .9862 .0100 .9228 

67 *0 .8915 .0025 .9887 .0014 .'9876 .0095 ,9324 

68 .0606 .9522 .0022 .9908 . .0014 .9990 .0084 ,9408 
fig .0 .9522 .0018 .9927 .0016 .9906 .0077 .9485 

70 .0 .9522 .0015 .9942 .0018 .9925 .0068 .9553 

71 .0 .9522 .0013 .9955 .0018 .9942 .0064 .961« 

72 .0 .9522 .0010 .9965 .0014 .9957 .0053 .9671/ 

73 .0 .9522 .0008 .'9974 .0010 .9966 .0052 I .9723 

74 .0 .9522 .0007 .9980 .0006 - .9973 .0047 .9771 

75 .0321 .9842 ,0005 .9986 .0004 .9977 ^ .0040 .981 J 

76 .0 .9842 .0004 .9990 .0003 .9979 .0036 ,9847 

77 .0 .9842 .0003 *9993 .0002 .9981 .0030 .9877 
• 78 .0 .9842 .0002 .9995 .0001 .9982 .0027 .99p5 

\ 79 .0 .9842 .0002 .9997 .0001 .9983 .0021 .9^26 

80 .0 .9842 .0061 .9998 .0000 .9983 .0020 .9945 

81 .0 .9842 .0001 .9999 .0000 .9983 .0015 .9960 

82 .0120 .9962 .0001 .9999 .0001 >9984 .0012 .9973 

83 .0 .9962 .0000 1.0000 ;0002 .9987 .0010 i9983 

84 .0 .9962 .0000 1^0000 .0002 .9989 .nOp7 .9989 

85 .0 .9962 .0000 1.0000 .0001 .9990 .0004 .9994 

86 .0 .9962 .0000 1.0000 .0000 .9990 .0002 .9996 

87 .0 .9962 .0000 1.0000 .0003 .9993 .0002 .9998 

88 . 0 . 9962 . 0000 1.0000 . 0004 . 9997 . 0001' .999.9 

89 .0038 1.0000 .0000 1.0000 .0002 .9998 .0001 1.0000 

90 .0 ' 1.0000 .0000 1.0000 .0001 1.0000 .0 l.OOOp 

ERIC; 



RESULTS FOR ITEM SAtlPLE # 8 



Score 



LINEAR 
PREDICTION 
C\imur 
latlve 
Piropor- Propor- 
tlon tlon 



NEGATIVE 
HYPERGEOMBTRIC 
Cumu- 
lative 
Propor-' Propor- 
tlon tlon 



GUESSING 
" FREE 

Cumu- 
lative 
Propor- Propor- 
t'lon tlon 



FREQUENCY 
DISTRIBUTION 
Cumu- 
lative 
Propor- Propor- 
tion _^_tion__ 



0 


.0 


.0 


.0000 


.0000 


.0000 


. .0000 


.0000 


.0000 


1 


.0007 


.0007 


.0000 


.0000 


.0000 


.0000 


.0 


.0000 


2 


.0 


.0007 


.0000 


.0000 


.0000 


.0000 


.0 


.0000 


3 


.0 


.0007 


.0000 


.0000 


.0000 


.0000 


.0 


• .0000 


4 


.0 


.0007 


.0000 


.0000, 


.0000 


.0000 


.0 


.0000 


5 


.0 


.0007 


.0000 


.0000 


.0000 


.0000 


.0000 


.0000 


6 


.0 


.0007 


.0000 


.0000 


.0000 


.0000 


.0000 


.qooo 


7 


.0045 


.X)051 


.0000 


.0000 


.0000 


.0000 


.oOoo 


.0001 


8 


.0 


.0051 


.0000 


.0000 


.0000 


.0000 


.0001 


.0002 


9 


.0 


.0051 * 


.0000 


.0000 


.0000 


.0000 


.0001 


.0002 


10 


.0 


.0051 


. 0000 


.0000 


.0000 


.0000 


.0002 


.0004 


11 


.0 


.0051 


.OOOO 


.0000 


.0000 


.0000 


.0003 


.0007 


12 


.0 


.0051 


.0000 


.0001 


.0000 


.0000 


.0003 


.0010 


13 


.0 


.0051 


.0000 


.0001 


.0000 


.0000 - 


.0006 


.0015 


14 


.0161 


.0212 


.0001 


.0002 


.0000 


.0000 


.0008 


.0024 


15 


.0 


.0212 


.0001 


.0003 


.0000 


.oooi 


.0012 


.0035 


16 


.0 


.0212 


.0001 


.0004 


.0000 


.0001 


.0014 


.0050 


17 


.0 


.0212 


.0002 


.0005 


.0000 


.0001 


.0017 


.0067 


18 


.0 


.0212 


.0002 


.0008 


.0000 


.0002 


.0025 


.0092 


19 


;o 


.0212 


.0003 


.0010 


.0001 


.0002 


.0029 


.012^ 


20 


.0 


.0212 


.0004 


.0014 


.0001 


.0003 


.0035 


.0156 


21 


.0347 


.0559 


.0005 


.0018 


.0001 


> .0005 


.0044 


.0201 




.0 


.0559 


.0006 


.0024 


.0002 


.0006 


.0059 


.0260 


'23 ■ 


.0 


.0559 


.0007 


.0031 


.0002 


,0009 


.0066 


.032^ 


24 


.0 


.0559 


.0009 


*.0040 


.0003 


.0012 


.0073 


.0404 


25 


.0 


.0559 


.0011 


.0050 


.0004 


.0016. 


.0091 


.0494 


26 


.0 


.0559 


.0013 


.0063 


.0006 


.0022 


.0107 


.0601 


27 


.0 


.0559 


.0015 


.0079 


.0009 


l0031 


.0116 


.0717 


28 


.0707 


.1266 


.0018 


.0097 


.0015 


.0046 


.0128 


.0846 


29 


.0 


.1266 


.0022 


.0118 


. 0026 


.0072 


.0151 


.0996 


30 


.0 


.1266 


.0025 


.0144 


.0040 


.0112 


.0167 


.1163 


31 


.0 


.1266 


.0029 


.0173 


.0058 


.0169 


.0183 


.1346 


32 


.0 


.1266 


.0034 


.0207 


.0076 


.0245 


.0202 


.1549 


33 


.0 


.1266 


.0039 


: .0246 


.0091 


.0336 


.0208 


.1757 


34 


:o 


.1266 


.0045 


.0291 


.0099 


.0435 


.0229 


.1986 


35 


.1191 


.2457 


.0051 


.0342 


.0100 


.0535 


.0248 


.2234 


36 


.0 ' 


.2457 


.0058 


.0400 


.0093 


.0628 


.0244 


.2478 


37 


.0 


.2457 


.0065 


.0464 


.0079 


.0707 


.0264 


.2742 


, 38 


.0 


.2457 


.0072 


.0537 


.0063 


.0770 


.0275 


.3017 


39 


.0 


.2457 


.0081 


.0617 


.0046 


.0816 


.0274 


.3291 


40, 


.0 


.2457 


.0689 


.0707 


.0032. 


.0847 


.0292 


.3583 


41 


.1756 


.4212 


.0099 


.0806 


.0020 


.0867 


.0288 


.3872 


42 


.0 


.4212 


.0108 


.0914 


10012 


.0879 


.0290 


.4161 


43 


.0 


.4212 


.0119 


.1033 


.0007 


.0886 


^0298 


.4459 


44 




.4212 


.0129 


.1162 


.0004 


.0890 


.0302 


' .4761 




.0 


.4212 


.0140 


.1302 


.0003 


.0893 


.0291 


.5052 



ITEM SAMPLE 8 ccmimmn 



Score 



LINEAR 
PREDICTION 
' Cum. 
Prop. Prop. 



NEGATIVE 
HYPERGEOMETRIC 
Cum. 
Prop. Prop. 



GUESSING 
FREE 

Cum. 
Protj. Prop. 



FREQOENCT^ 
DISffeEUnON 
Cum.. 

Prop. Prop. 



ERIC 



46 


















.0 


.4212 


.0151 


.1453 


0007 


OQOl 




.5351 


47 


.0 


.4212 


.0163 


1616 


0019 

. \J\JM 7 


0920 


0285 


.5635 


48 


.2022 


.6234 


.0174 


1790 




09A2 


0278 

. OA / o 


S913 

. J7X J 


49 


.0 


.6234 


0186 


1977 

. X 7 r / 


.0079 




0277 

. OA / / ■ 


6190 


50 


.0 


. 6234 


.0198 


2174 

. ^x § ^ 




1177 

. XX / / 


0263 


6453 


51 


.0 


. 6234 


* .0209 


2384 




1 391 


. y / AH 7 


6702 

.Of VA. 


52 
53 


.0 


.6234 


.0221 


2605 

. mm V\U 


0314 ' 


170S 


0244 

. OAHH 


< 6946 

. 07H0 


.0 


• 6234 


. ,0232 


2837 




21 29 


0233 


71 7*9 

. / X/ 7 


54 


.0 


.6234 


.0243 


3080 


. 1/ jA J 


2 ASA 


0221 

. OAAX 


7399 


55 


• 2034 


.8268 


.0253 


3333 


0591 


3245 


0216 


7615 


56 


.0 


.8268 


.0263 


3595 


0^03 




0201 


7816 

. r wXV 


57 


.0 


.8268 


0271 




OSSft 

. JO 




01 91 

. OX7x 


8007 
• ooo/ 


58 


.0 


.8268 


.0279 


4146 




A873 

.. HO / >J 


0177 

. ox / / 


.8183 


59 


• 0 , 


.8268 


.0286 


14432 


.0356 


. 5229 


.0159 

. wX ^7 


.8342 


60 


• 0 


.8268 


.0292 


.4725 


0246 


5475 


0153 


.8496 


61 


.0 


.8268 


.0297 


.5022 


.0154 


5630 


.0149 

. vx^ ^ 


.8645 


62 


.1300 


.9567 


.0301 


.5323 


.0088 


. 5718 


.0136 


.8781 


63 


. .0 


.9567 


.0303 


.5625 


0046 


S764 

• Ji OH 


. 0125 


8905 


64 


• 0 


.9567 


.0303 


.5928 


. 0022 


.5786 


.0113 


.9019 


65 


.0 


.9567 


.0302 


.6231- 


.0016 


.5802 


.0110 


.9129 

. ^X i* ^ 


66 


.0 


.9567 


. 0300 


.6530 


.0038 


5840 


0100 


.9228 


67 


' .0 


.9567 


.0296 


.6826 


0114 


S9SS 


009 S 


9324 i 

. 7.^ AH V 


68 


. 0433 


1 0000 


0290 


.7116 




A216 
. o^xo 


OOAA 


9A08 


69 


.0 


1.0000 


0282 


7398- 


OA S3 


AA70 


0077 
. oo/ / 


9485^ 

. 7HO 


70 


.0 


1.0000 


0273 


7671 


. vOX / 


72S7 


, . oooo 


9553 


71 


.0 


l.oodo 


.0262 


.7933 


0687 


7^73 


' 0064 


9618 


72 


.0 


1.0000 


.0250 


. 8183 

• UXV«J 


t)645 


8618 


0053 


.9671 


73 


.0 


1.0000 


. 0237 


,8420 


0520 


9139 


0052 


9723 


74 


.0 


1.0000 

A . .WW 


,0222 


.8642 


0363 


9501 


0017 


.9771 

. 7 f f X 


75 


.0 


1.0000 

• . VW V 


.0206 


8847 / 


0221 


0722 


0040 


9813 


76 


.0 


1.0000 


.0189 


.9036 / 


0124 


9845 

. 370H J 


0036 


9847 


77 


.0 


1.0000 


.0171 


.9207 / 


.0070 


.9915 


.0030 


.9877 


78 


.0 


1.0000 


.0153 


.9360 / 


.0041 


.9957 


.0027 


.9905 


79 


.0 


1.0000 


.0135 


.9495/ 


.0023. 


.9980 


*002i 


.992f 


80 


.0 


1*0000 


.0116 


.9612 


.0011 ? 


.9991 


.0020 


.9945 


81 


v6 


1.^00Q 


.0099 


.97m 
.9791 


.0004 


.9995 


.0015 


.996f 


62 


.0 


1.0000 


.0081 


.0001 


.9996 


.0012 


.997- 


83 


.0 


1.0000 


.0065 


.9^57 


. .0001 


.9997 


.0010 


.998:- 


84 


.0 


i.dooo 


.0050 


.9907 


.pool 


.9998 


.0007 


.998? 


85 


.0 


1.0000 


.0037 


.9944 


.0001 


.9999 . 


.0004 , 


.999' 


86 


.0 


1.0000 


.0026 


/ ,9970 
.9986 


.0000 


.9999 


.0002 


.999< 


87 


' .0 


1.0000 


. .0016 


.0000 


.9999„. 


. 0002 


.999? 


88 


.0 


1.0000 


' .0009 


.9995 


.0000 


.9999 


.0001 


.999f 


89 


iO 


1.0000 ' 


.0004 


.9999 


.0000 


.9999 


.0001 


1.000- 


90 

t-. 


.0 

. • 


1.0000 ' 


.OQOl 


1.0000 


.0001 


1.0000 


•0 \ 


1.000' 



BESULTS FOR ITBM SAMPLE # 9 



LINEAR NEGATIVE \ GUESSING , FREQUENCE 

PSEDICTIOH H7PBRGE0METRIC FREE DISTRIBUTION 







Cunu- 




Cunu- 




Cunu- 




Cuimi- 






lative 




lative 


■ 


latlye 




lative 


Score 


Propor- 


Propor- 


Propor- 


Propor- 


Propor- 


Propor- 


Propor- 


Ptopor- 




tion 


tion 


tion 


. tlon ^ 


tion 


tion 


tion' 


tion 


0 


.0 


.0 


.0000 


.0000 


.0000 


.0000 


.0000 


.0000 


1 




.0 


.0000 


.0000 


.0000' 


.0000 


.0 


.0000 


2 


.0 


.0 


.0000 


.0000 


.0000 


.0000 


.0 


.0000 


3 


.0 


.0 


.0000 


.0000 


.0000 


.0000 


, .0 


.0000 


4 


.0 


.0 i 


.0000 


.0001 


.0000 


.0000 


.0 


.0000 


5 


.0 


.0 


.0001 


^0001 


.0000 


.0000 


.0000 


.0000 


6 


.0 


.0 


.0001 


.0002 


.0000 


.0000 


.0000 


.0000 


7 


.0 


.0 


.0002 


.0004 


.0000 


.0000 


. .0000 


.0001 ' 


8 


.0 


.0 


.0003 


.0006 


.0000 


.0000 


.0001 


.0002 


9 


.0 


.0 


.0004, 


.0010 


.0000 


.0000 


.0001 


.0002 


10 


.0 


.0 


.00015 


.0015 


.0000 


.0000 


.0002 


.0004 


n 


.0030 


.0030 


.0007 


.0023 


.0000 


.0001 


.0003 


.0007 


12 


.0 


.0030 


.0010 


.0033 


.0001 


.oooi 


.0003 


.0010 


13 


.0 


.0030 


.0013 


.0046 


.0001 


.0002 


.ooo6:_ 


__-^15 


14 


.0 


.0030 


.0017 


.0062 




: -.-0004 — """"70008 


.0024 


15 


.0 


.0030 


/.0021 


.0083 


.0002 


.0005 


.0012 


.003$ 


16 


.0 


.0030 ^ 


.0026 


.0109 


.0002 , 


.0008 


.0014 


.0050 


17 


,0 


.0030 


.0032 


.0141 


.0003 


.0011 


.0017 


.0067 


18 


.0175 


.0205 


.0038 


.0179 


.0004 


.0014 


.0025 


.0092 


19 


.0 


.0205 


.0045 


.0224 


.0004 


.0019 


.0029 


.0121 


20 


.0 


.0205 


.0053 


.0276 


.0005 


.0024 


.0035 


.0156 


21 


.0 


.0205 


.0061 


.0337 


.0006 


.0036 


.0044 


.0201 


22 


.0 


.0205 


.0070 


.0408 


.0008 


.0038 


.0Q59 


.0260 


23 


.0 


.0205 


.0080 


.0488 


.0010 


.0047 


.0066 


.0325 


24 


.0 


.0205 


.0090 


.057)8 


.0012 


.0059 


^ .0078- 


.0404 


25 


.0705 


.0910 


.0101 


.0679 


.0015 


.0074 


.0091 


.0494 


2$ 


.0 


.0910 


.0112 


.0792 


,0020 


.0095 


.0107 


.0601 


27 


.0 


.0910 


.0124 


.0916 


.0028 


.0123 


.0116 


.0717 


28 


.0 


.0910 


.0136 


.1652 


.0040 


.0162 


.0128 


.0846 


29 


.0 ° 


.0910 


.0148 


.1200 


.0056< 


.0218 


.03.51 


.0996 


^ 30 


.0 : 


-.0910 


-^60- 


.1360 


.0080 


.0298 


.0167 


.1163 


31 


.0 


«0910 


.0172 


.1533 


.0115 


.0413 


.6183 


.1346 


— 32 


' .1260 


.2170 


.0184 


.1717 


.0167 


.0579 


.0202 


.1549 


33 


.0 


.2170 


,0i96 


.1914 


.0240 


.0820 


.0208 


.1757 


34 


.0 


.2170 


.0208 


.2121 


.0335 


.1154 


.0229 


.1986 


35 


.0 


.2170 


.0219 


.2340 


.0443 


.1597 


^0248 


.2234 ' 


36 


.0 


.2170 


.0229 


.2569 ^ 


.0547 


.2145 


.0244 


.2478 


37 


.0 . 


.2170 


.0239 


.2808 


.. .0627 


.2771 


' .0264 


.2742 


38 


.0 


.2170 


.0248 


.3056 


.0662 


.3434 


.0275 


.3017 


39 


.1847 


.4017 


.0256 


.3311 


.0646 


.4079 


.0274 


.3291 


40 


.0 


.4017 


.0263 


.3574 


.0580 


.4660 


.0292 


.3583 


41 


.0 


.4017 


.0269 


.3843 


.0483 


.5142 


.0288 


.3872 


42 


.0 


.4017 


, .0274 


.4117 


.0373 


.5515 


.0290 


.4161 


43 


.0 


.4017 


.0278 


.4395 


.0272 


.5788 


.0298 


; .4459 




.0 ' 


.4017 


.0281 


.4676 


.0194 


.5982 


.0302 


.4761 


ERIC^ 


.0 


.4017 


.0282 


.4958 


.0146 


.6128 


.0291 


.5052 



ITEM SAMPLE # 9 CONTimffiD 



LINEAR NEGATIVE GUESSING FREQUENCY 

PREDICTION HiiPERGEOMETRIC FREE / DISTRIBUTION 

Cum. Cum. Cum. ~ Cum. 

Score Prop. Prop. Prop. Prop. Prop. Prop. Prop. Prop. 



46 


.1972 


.5988 


47 


.0 


.5988 


48 


.0 


.5988 


49 


.0 


.5988 


50 




.5988 


51 


To^ 


.5988 


52 


.0 


.5988 


53 


.1^90 


.7678 


54 


.0 


.7678 


55 


.0 


.7678 


56 


.0 


.7678 


^57 


.0 


.7678 


58 


.0 


.7678 


59 


.1173 


.8851 


60 


.0 


.8851 


61 


.0 


.8851 


62 


.0 


.8851 


63 


.0 


.8851 


64 


.0 


.8851 


65 


.0 


.8851 


66 


.0719 


.9570 


67 


.0 


.9570 


68 


.0 


.9570 


69 


.0 


.9570 


70* 


.0 • 


.9570 


71 


.0 


.9570 


72 


.0 


.9570 


73 


.0333 


.9903 


74 


.0 


.9903 


75 


;.0 


.9903 


76 


.0 


.9903 


77 


.0 


.9903 


78 


.0 


.9903 


79 


.0 


.9903 


80 


.0097 


1^0000 


81 


.0 


1.0000 


82 


.0 


1.0000 


83 


.0 


1.0000 


84 


.0 


1.0000 


85 


.0 


1.0000 


86 


.0 


1.0000 


87 


.0 


1.0000 


88 


.0 


1.0000 


89 


.0 


1.0000 


90 


.0 


1.0000 




.0283 


.5241 


.0124 


.0282 


.5523 


.0119 


0279 


.5802 


.0121 


.0276 


.6078 


.0121 


.0272 


.6350 


.0117 


.0266 


.6616 


, .0114 


.0259 


.6875 


.0119 


.0252 


. 7126 


.0137 


.0243 


.7369 


_-^0l64 


.0233- 


.7603 


.0192 


.0223 


.7826 


.0212 


.0212 


.8038 


.0226 


.0201 


.8239 


.0237 


.0189 


.8428 


.0247 


.0177 


.8606 


.0249 


.0165 


.8770 


.0239 


.0152 


.8923 


.0218 


.0140 


.9063 


.0191 


.0128 


.9191 


.0161 


.0116 


.9307 


.0128 


.0104 


.9411 


.0094 


.0093 


.9505 


.0063 


.0082 


.9587 


.0039 


.0072 


.9659 


.0027 


.0063 


.9722 


.0023 


. .0054 


.9776' 


.0024 


.0046 


.9822 


.0024 


.0039 


.9861 


.0021 


.0032 


.9893 


.0019 


.0026 


.9919 


.0015 


.0021 


.9940 


, .0012 


.0017 


.9957 


.0009 


.0013 


.9970 


. 0007 


.0010 


.9979 


.0005 


.0007 


.9986 


.0003 


.0005 


. 9991 


.0001 


.0003 


.9995 


.0001 


.0002 


.9997 


.0000 


.0001 


.9998 


. .0000 


.0001 


.9999 


.0005 


.0000 


1.0000 


.0014 


.0000 


1.0000 


■ .0011 


.0000 


1.0000 


.0004 


.0000 


1.0000 


.0008 


' .0000 


1.0000 


.0007 



.6251 


.0299 


.5351 


.6370 


.0285 


.5635 


.6491 


.0278 


.5913 


.6612 


.0277 


.6190 


. 6729 


.0263 


.6453 


-.6843 


.0249 


.6702 


.6962 


.0244 


.69.46 


.7099 


.0233 


.7179 


;7264 


.0221 


.7399 


.7455 


.0216 


.7615 


.7667 


.0201 


.7816 


.7893 


.0191 


.8007 


.8130 


.0177 


.8183 


.8377 


.0159 


.8342 


.8626 


.0153 


' .8496 


.8865 


.0149 


.8645 


.9082 


.0136 


.8781 


.9273 


.0125 


.8905' 


.9433 


.0113 


.9bi9 


.9561 


.0110 


.9129 


.9656 


.0100 


.9228 


.9719 


.0095 


.9324 


.9758 


..0084 


.9408 


.9785 


.0077 


.9485 


.9808 


.0068 


.9553 


.9832 


.0064 


.9618 


.9856 


.0053 


.9*71^ 


.9878 


.0052 


.9723 


.9896 


.0047 


.9771 


.9911 


.0040 


.9811 


.9923 


.0036 


.9847 


.9932 


.0030 


.9877 


.9940 


.0027 


.9905 


.9945 


.0021 


.9926 


.9948 


.0020 


.9945 


.9950 


.0015 


.9960 


.9950 


. .0012 


.9973 


.9950 


.0010 


.9983 


.9950 


.0007 


.9989 


.9955 


.0004 


.9994 


.9970 


.0Q02 


.9996 


.9981 


.0002 


."9998 


.9985 


.0001 


.9999 


.9993 


.0001 


1.0000 


1.0000 


.0 


i.oooq 



